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Recent investigations suggest that both spin-orbit coupling and electron correlation play very 
crucial roles in the 5d transition metal oxides. By using the generalized Gutzwiller variational 
method and dynamical mean-field theory with the hybridization expansion continuous time quantum 
Monte Carlo as impurity solver, the three-band Hubbard model with full Hund's rule coupling and 
spin-orbit interaction terms, which contains the essential physics of partially filled t^g sub-shell of 
5d materials, is studied systematically. The calculated phase diagram of this model exhibits three 
distinct phase regions, including metal, band insulator and Mott insulator respectively. We find that 
the spin-orbit coupling term intends to greatly enhance the tendency of the Mott insulator phase. 
Furthermore, the influence of the electron-electron interaction on the effective strength of spin-orbit 
coupling in the metallic phase is studied in detail. We conclude that the electron correlation effect 
on the effective spin-orbit coupling is far beyond the mean-field treatment even in the intermediate 
coupling region. 



I. INTRODUCTION 

The Mott metal-insulator transition (MIT) induced by 
electron-electron correlation has attracted intensive re- 
search activities in the past several decades^—. Although 
the main features of Mott transition have already been 
captured by single-band Hubbard model, most of Mott 
transition in realistic materials have multi-orbital nature 
and should be described by multi-band Hubbard model. 
Unlike the situation in single-band case, where the Mott 
transition is completely driven by the local Coulomb in- 
teraction U, the Mott transition in multi-band case is 
affected by not only Coulomb interaction but also crys- 
tal field splitting and Hund's rule coupling among dif- 
ferent orbitals^—. The interplay between Hund's rule 
coupling and crystal field splitting generates lots of inter- 
esting phenomena in the multi-band Hubbard model, for 
examples, orbital selective Mott transition, high-spin to 
low-spin transition and orbital ordering. Therefore, most 
of the intriguing physics in 3c? or Ad transition metal com- 
pounds can be well described by the multi-band Hubbard 
model with both Hund's rule coupling and crystal field 
splitting. 

In the present paper, we would like to concentrate our 
attention on the Mott physics in another group of inter- 
esting compounds, the 5d transition metal compounds, 
where spin-orbit coupling (SOC), the new physical in- 
gredient in Mott physics, plays an important role. Com- 
pared to 3d orbitals, the 5<i orbitals are much more ex- 
tended and the correlation effects are not expected to be 
important here. While as firstly indicated in reference 8 , 
the correlation effects can be greatly enhanced by SOC, 



which is commonly strong in 5d materials. The first well 
studied 5d Mott insulator with strong SOC is Sr2lr04, 
where the SOC splits the ti g bands into (upper) j c ff =1/2 
doublet and (lower) j e gf = 3/2 quartet bands and greatly 
suppresses their bandwidths^— . Since there are totally 
five electrons in its 5d orbitals, the j e g = 1/2 bands are 
half filled and the j e g = 3/2 bands are fully occupied, 
which makes the system being effectively a j c g = 1/2 
single-band Hubbard model with reduced bandwidth. 
Therefore the checkerboard anti-ferromagnetic ground 
state of Sr2lr04 can be well described by the single-band 
Hubbard model with half filling. 

Here, we will focus on the 5d materials with four elec- 
trons in the t2 g sub-shell. These materials include the 
newly discovered BaOs03, CaOs03 and NalrOs etoi£. 
All these materials share one important common feature: 
in low temperature, these materials are insulators with- 
out magnetic long-range order. The origin of the insu- 
lator behavior can be due to two possible reasons, the 
strong enough Coulomb interaction and SOC. We will 
have Mott insulator in the former and band insulator in 
the latter case respectively. Therefore it is interesting 
to study the features of metal-insulator transition in a 
generic ti g system occupied by four electrons with both 
Coulomb interaction and SOC. 

In the present paper, we study the t% g Hubbard model 
with SOC and four electrons filling by using rotational in- 
variant Gutzwiller approximation (RIGA) and dynamical 
mean-field theory combined with the hybridization ex- 
pansion continuous time quantum Monte Carlo (DMFT 
+ CTQMC) respectively. The paramagnetic U — £ phase 
diagram is derived carefully. Further, the interplay be- 
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tween SOC £ and Coulomb interaction U is analyzed in 
detail. We will mainly focus on the following two key is- 
sues: (i) How does the SOC affect the boundary of Mott 
transitions in this three-band model? (ii) How does the 
Coulomb interaction modify the effective SOC strength? 

This paper is organized as follows. In Sec. HH the three- 
band model is specified, and the generalized multi-band 
Gutzwiller variational wave function is introduced. In 
Sec. IIII A[ the calculated results, including U — ( phase 
diagram, quasi-particle weight and charge distribution, 
for the three-band model are presented. The effect of 
Coulomb interaction on SOC is analyzed in Sec. IIII Bl 
Finally we make conclusions in section llVl 



II. MODEL AND METHOD 

The three-band Hubbard model with full Hund's rule 
coupling and SOC terms is defined by the Hamiltonian: 



H — ^i] d \,a<y d j,o.a 



, H loc = H kin + H ioc , (1) 



where a denotes electronic spin, and a represents the 
three ti g orbitals with a — 1,2,3 corresponding to 
dy Z ,d zx ,d xy orbitals respectively. The first term de- 
scribes the hopping process of electrons between spin- 
orbital state "etc" on different lattice sites i and j. Local 
Hamiltonian terms H} oc — H % u + H\ oc contain Coulomb 
interaction HI and SOC H l soc (In the following, the site 
index is suppressed for sake of simplicity) . 



H u = U n at n Q I + U' 



a<.b,oa' 



a<b,a 



a 

J xy ( d lt da ^ d H d ^ + d lt d li d b^ d H + h - c ) > ( 2 ) 
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H soc = C,{av\l x s x + lySy + l z s z \ba')dl a d ba ,, (3) 

acr ba' 

where U (If) denotes the intra-orbital (inter-orbital) 
Coulomb interaction, J z term describes the longitudinal 
part of the Hund's coupling. While the other two J xy 
terms describe the spin-flip and pair-hopping process re- 
spectively. C is SOC strength, l(s) is orbital (spin) an- 
gular momentum operator. Here we assume the studied 
system experiences approximately cubic symmetry (Oh 
symmetry), in which two parameters U' and J xy follow 
the constraints U' — U~2J and J xy = J z = J. Here we 
choose J/U = 0.25 for the systems studied in this paper 
unless otherwise noted. This lattice model is solved in 
the framework of RIGAii-JZ and DMFT(CTQMC)^^ 
methods respectively, which are both exact in the limit 
of infinite spacial dimension a 20 ' 21 . In this w ork, a semi- 
elliptic bare density of states p(e) — (2/irD)y/l — (e/D) 2 
is adopted, which corresponds to Bethe lattice with infi- 
nite connectivity. In the present study, the energy unit 



is set to be half bandwidth D = 1 and all orbitals are 
assumed to have equal bandwidth. 

Next, we will briefly introduce the recently developed 
RIGA method—. The generalized Gutzwiller trial wave 
function \^g) can be constructed by acting a many- 
particle projection operator V on the uncorrelated wave 
function 1*0^—, 

\Vg) = P\*o), (4) 



with 



7, = n^ = nE A rr'|r), i (r'| 



(•5) 
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l^o) is normalized uncorrelated wave function in which 
Wick's theorem holds. |r)j are atomic eigenstates on 
site i and Arr' are Gutzwiller variational parameters. In 
our work, |r)j are eigenstates of atomic Hamiltonian H u , 
each |r)j is labeled by good quantum number N,J,J Z , 
where Af is total number of electrons, J is total angular 
momentum, J z is projection of total angular momen- 
tum along z direction. The non-diagonal elements of the 
previously defined variational parameter matrix Arr' are 
assumed to be finite only for state belonging to 

the same atomic multiplet, i.e, with the same three quan- 
tum labels 15 . In the following, we assume the local Fock 
terms are absent in I'l'o), 



(6) 



For general local unitary transformation matrix 

A is needed to transform the original di a -hasis into the 
so-called natural Cj m -basisi£, i.e, d a — ~}2 m A a mCm- In 
the original single particle basis (d yz ti^i/z4-! 'fzxtAxJ'j 
d X yt,d xy \.), SOC term is expressed as : 
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Then the transformation matrix A is as follows: 
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where the ti g orbitals have been treated as a system with 
l c tf = 1. 

In the natural single particle basis, SOC matrix is 
transformed into: 
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Meanwhile the Coulomb interaction term is transformed 
as: 

^ U a pS7<tf a d'pds<Ly = ^ UmnklclnClckCl, (10) 
a/3 ^7 



innhl 



with 



Urnnkl — ^ ^ U a j3$^J\) rna A n pA&k>A~{l . (H) 

a/3 (57 



Fix n° in each orbital 



initial guess of rcnormalization factor TZ 



right-hand side of the above equation equaling to some 
desired occupation number mP a . Then we minimize the 
energy respect to n° a at the last step. 

The remaining task is to minimize the variational 
ground energy E = E k i n + Ei oc with respect to Arr' 
and l^o): arL d fulfill the previous two constraints. Here, 



ij 7 (5 

(16) 



and 



E loc = (* G |iJ ;oc |* G ) = Tr(^H locq 
with t, 1Z and <f> defined as: 



(17) 



construct Gutzwillcr effective one-particle Hamiltonian, 
and solve the Hamiltonian to get dE/d7Z. 



d — = y ( dEkm 9Ekin ^ 



9Ei oc 



a 

solve the equations to get rcnormalization factor TZ 




calculate quantities: 
total energy, occupation . 



FIG. 1. Flowchart of the RIGA self-consistent loop to mini- 
mize total energy E(n°) with respect to \^o) and Apr'- 

In this paper, we define expectation value with uncor- 
rected wave function: 



0° = (* |0|*o), 



(12) 



while expectation value with Gutzwiller wave function is 
defined as: 



a/3 



f Tr(0t c t0c 7 ) 



(18) 



(19) 



(20) 



where \I) stands for a many-body Fock state and 

n° = (*o|n 7 |*o)- 

The flowchart of RIGA method is shown in Fig [l] For 
fixed n° a in each orbital, minimizing E with respect to 
l^/o) and Arr' can be divided into two steps in each iter- 
ative process. Firstly, fix Gutzwiller variational parame- 
ters Arr' and find optimal uncorrelated wave function by 
solving effective single particle Hamiltonian, 



i^j 7(5 



(21) 



where Lagrange parameters rj a are used to minimize the 
variational energy fulfilling Gutzwiller constraints. Sec- 
ondly, we fix the uncorrelated wave function, and opti- 
mize the variational energy with respect to Gutzwiller 
variational parameters Arr' , 



o = o G = (* g |0|*g) 



(13) 



During the minimization process, two following con- 
straints are forced, 



(*o|P + P|*o) = 1, 



and 



^>o\V J Vn ia \^ a ) = *o \n ia * c 



(14) 



(15) 



In the present paper, the second constraint is satisfied 
in the following way. We first calculate the total energy 
of the trial wave function with both the left-hand and 
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9Arr' 



= 0, 



(22) 



where n' a = (^o\V^Vn a \9 ), In this way, A r r' and |* ) 
are self-consistently determined. 

For the fix mP a algorithm, we need to scan the n° to 
get the global ground state of the studied system. In 
this paper, because SOC will split the ti g orbitals into 
two fold jeff =1/2 and four fold j c g = 3/2 states, we can 
introduce an alternative variable Sn° to determine for 
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each orbital. The occupation polarization Sn° is defined 
as: 

5n° = n° /2 - n° 1/2 , (23) 

in which riy 2 and , 2 stand for the average occupa- 
tion number of lower (j g = 3/2) and upper (j e g = 1/2) 
orbitals respectively. Since total electron number of 
the system is fixed to be 4nf^ 2 + 2n°^ 2 = 4, we have 

< Sn° < 1. Sn° (n°) corresponding to ground state is 
denoted by 5n g {n° g ). 

In the present paper, we also use DMFT+CTQMC 
method to crosscheck our results derived by RIGA. For 
DMFT+CTQMC method, the system temperature is set 
to be T = 0.025 (corresponding to inverse temperature 
j3 = 40). In each DMFT iteration, typically 4 x 10 8 
QMC samplings have been performed to reach sufficient 
numerical accuracy 2 ^. 

III. RESULTS AND DISCUSSION 

A. U-C, phase diagram 

In this subsection, we mainly focus on phase diagram 
for the three-band model proposed in Eq.([T|). The ob- 
tained U — £ phase diagrams with J/U — 0.25 are shown 
in Figj2] The upper panel shows the phase diagram cal- 
culated by zero temperature RIGA method, while the 
calculated results by DMFT+CTQMC method at finite 
temperature is shown in the lower panel. The results ob- 
tained by two different methods are consistent with each 
other quite well except that DMFT+CTQMC can not 
distinguish between band insulator and Mott insulator, 
which will be explained later. Apparently, there exists 
three different phases in U— C plane: metallic state in the 
lower left corner, band insulator in the lower right region 
and Mott insulator in the upper right region. The gen- 
eral shape of the phase diagram can be easily understood 
by considering two limiting cases: (i) For £ = 0, one has 
a degenerate three-band Hubbard model populated by 4 
electrons per site. The model will undergo an interaction 
driven Mott transition at critical U c /D ~ 11.0 with each 
band filled by 4/3 electrons, (ii) For non-interacting case 
(U = 0.0), the model is exactly soluble. The three bands 
are degenerate and filled by 4/3 electrons at £=0.0. Fi- 
nite £ will split the three degenerate bands into a (lower) 
Jeff = 3/2 quadruplet and (upper) j g =1/2 doublet with 
energy separation being 1.5£. Increasing £ will pump 
electrons from upper to lower orbitals until the upper 
bands are completely empty and the system undergoes a 
metal to band insulator transition, which is expected at 
C/D = 1.33. 

In order to clarify the way we determine the metal, 
band insulator, and Mott insulator phases by RIGA 
method, in Fig|3]we plot the total energy and quasipar- 
ticle weight as a function of Sn° defined in the previous 
section , where the SOC strength is fixed at (/D = 0.7, 
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FIG. 2. (Color online) Phase diagram of three-band Hub- 
bard model with full Hund's coupling terms in the plane of 
Coulomb interaction U(J/U = 0.25) and spin-orbit coupling 
Upper panel: The phase diagram is calculated by RIGA at 
zero temperature. Lower panel: The phase diagram is calcu- 
lated by DMFT+CTQMC with finite temperature T = 0.025. 



and from top to bottom the Coulomb interaction is 
U/D = 1.0, 3.0, 6.0. The ground state of the system 
is the state with the lowest energy respect to Sn°. The 
typical solution for the metal phase is shown in Figj3ji, 
where the energy minimum occurs at < 5rP g < 1.0 cor- 
responding to the case that all orbitals being partially 
occupied. While for a band insulator, as shown in Figj^b 
as a typical situation, the energy minimum happens at 
8nP g = 1.0 corresponding to the case that the j c g = 3/2 
orbitals are fully occupied and j c g = 1/2 orbitals are 
empty, and more over the quasiparticle weight Z keeps 
finite when Sn° approching unit. And finally the situ- 
ation of a Mott insulator is illustrated in Fig|3t, where 
the quasiparticle weight Z vanishes at some critical (5n°, 
above which the system is in Mott insulator phase and 
can no longer be described by the Gutzwiller variational 
method. 

While in the DMFT+CTQMC calculations, the phase 
boundary between metal and insulator is identified by 
measuring the imaginary-time Green function at r = 
/3/ 2 26 ' 27 . Since G((3/2) can be viewed as a representa- 
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0.0 0.2 0.4 0.6 0.8 0.0 0.2 0.4 0.6 0.8 1.0 

6n° 6n° 

FIG. 3. (Color online) Total energy E(Sn°) and quasipar- 
ticle weight Z(5n°) as a function of occupation polarization 
Sn° — — n i/2 f° r different values of interaction strength 
U/D = 1, 3, 6 (J/U = 0.25) at fixed (/D = 0.7 and zero 
temperature, where n^i 2 is average occupation number of 
Jeff = 3/2 quadruplet, n5/ 2 m average occupation number of 
joff = 1/2 doublet. 
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FIG. 4. (Color online) The imaginary-time Green function 
at r = ft/ 2 as a function of Coulomb interaction strength U . 
The SOC strength f is chosen to be 0.5 as a illustration. The 
calculation is done by DMFT+CTQMC method at P = 40. 
In this figure the normalized quantities by G(P/2) at U/D = 
1.0 are shown and the arrows correspond to phase transition 
points. 



tion of the integrated spectral weight within a few fc^T 
of Ep, so it can be used as an important criterion to 
judge whether metal-insulator transition occurs. The 
corresponding results for SOC strength Q/D = 0.5 are 
shown in FigJU Clearly seen in this figure, the critical U c 
is about 3.5, and both the j c g = 3/2 and j e g = 1/2 
orbitals undergo metal-insulator transitions simultane- 
ously. Since there is chemical potential ambiguity in 
the insulator phase, it is difficult to further distinguish 
Mott insulator from band insulator by DMFT+CTQMC 
method. Therefore we only calculate the phase boundary 
between the metal and insulator phase, which is in good 
agreement with the results obtained by RIGA. 

Now, we come back to discussed the phase diagram 
obtained by RIGA and DMFT. When both the Coulomb 
interaction U and SOC £ are finite, the phase diagram 
looks a bit complicated. By considering different values 
of SOC, we divide the phase diagram vertically into three 
regions. 

Firstly, for 0.00 < (/D < 0.24, with increasing 
Coulomb interaction U, our calculation by RIGA pre- 
dicts a transition from metal to Mott insulator. The 
transition is characterized by the vanishing of quasiparti- 
cle weight as discussed previously. The critical Coulomb 
interaction U c decreases drastically with the increment of 
SOC, the effect of SOC tends to enhance the Mott MIT 
greatly. The DMFT results show very similar behavior 
in this region as shown in lower panel of FigJ21 except 
that the U c obtained by DMFT has weaker dependence 
on the strength of SOC compared to that of RIGA. From 
the view point of DMFT, the suppression of the metallic 
phase by SOC can be explained quite clearly. For the 
effective impurity model in DMFT, the metallic phase 
corresponds to a solution when the local moments on the 



impurity site are fully screened by the electrons in heat- 
bath through the Kondo like effect. With the SOC, there 
is an additional channel to screen the local spin moment 
other than the Kondo effect, which leads to the formation 
of spin-orbital singlets. This additional screening chan- 
nel, which is completely local, will thus compete with the 
Kondo effect and suppress the metallic solution. There 
is no net local moment left in this type of Mott phase, 
and the ground state is simply a product state of local 
spin-orbital singlets on each site. 

For 0.24 < (/D < 1.33, two successive phase transi- 
tions are observed with the increment of U. The transi- 
tion from metallic to band insulator phases occurs firstly, 
and followed by another transition to the Mott insula- 
tor phase. In the intermediate U region, the effective 
band width of system is reduced by the correlation ef- 
fects, which drives the system into a band insulator phase 
with relative small band splitting induced by SOC. Fur- 
ther increasing interaction strength U will push the sys- 
tem to the Mott limit. Although this process is believed 
to be a crossover rather than a sharp phase transition, 
our RIGA calculation provides a mean field description 
for these two different insulators, where in the band in- 
sulator phase the interaction effects only renormalize the 
effective band structure and do not suppress the coher- 
ent motion of the electrons entirely. Similar behavior can 
also be obtained by DMFT method, where the quasipar- 
ticle weight determined by DMFT selfenergy keeps finite 
for the band insulator phase and vanishes for the Mott 
insulator phase. 

At last, for (/D > 1.33 region, the orbitals are fully 
polarized with electrons fully occupied j e ff = 3/2 bands 
and fully empty j e ff — 1/2 bands at U = 0.0, indicating 
that the system is in the band insulator state already 
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in the non-interacting case. Similar band insulator to 
Mott insulator transition will be induced with further 
increment of U in the RIGA description, as discussed 
before. 
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FIG. 5. (Color online) Quasiparticle renormalization factors 
Z of the lower orbitals (j c a = 3/2 quadruplet) and upper 
orbitals (j e g = 1/2 doublet) as function of Coulomb inter- 
action U(J/U = 0.25) for different values of SOC (Q/D = 
0.1,0.5, 1.5). The dashed lines label the critical U for transi- 
tion to Mott state. The results are obtained by zero temper- 
ature RIGA method. 




U/D 

FIG. 6. (Color online) Occupation number of the lower 
orbitals (j e g = 3/2 quadruplet) with increasing Coulomb 
U(J/U = 0.25) for selected SOC {Q/D = 0.1,0.5,1.5). Both 
the calculated results by RIGA and DMFT(CTQMC) are pre- 
sented. 

For several typical SOC parameters (Q/D = 
0.1,0.5, 1.5) in the three regions defined above, we study 
the evolutions of quasiparticle weight and band specific 
occupancy with Coulomb interaction. The quasiparti- 
cle weight for selected SOC with increasing U is plotted 
in FigO The upper (lower) panel shows the quasiparti- 
cle weight for j e g = 3/2 (1/2) orbitals. Note the quasi- 
particle weight in RIGA is defined as the eigenvalues of 
the Hermite matrix TVTZ. For both Q/D = 0.1 and 1.5, 
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FIG. 7. (Color online) Expectation value of orbital angular 
momentum (£ 2 ), spin angular momentum (<S 2 ), and total an- 
gular momentum (J 2 ) as function of Coulomb interaction U 
with fixed spin-orbit coupling strength Q/D = 0.7. It is de- 
rived by RIGA at zero temperature and DMFT+CTQMC at 
f3 — 40 respectively. 



the quasiparticle weights decrease from 1 to monoton- 
ically with the increasing interaction strength U and J 
until the transition to Mott insulator phase. While for 
Q/D = 0.5, there exists a kink at U /D = 2.7 in the lower 
panel (j e ff = 1/2), which corresponds to the transition 
from metal to band insulating state. For transition to 
Mott insulating state, quasiparticle weights for all the 
orbitals reach zero simultaneously, with U c /D — 6.7 for 
Q/D = 0.1, U c /D = 4.5 for Q/D = 0.5, and U c /D = 4.0 
for C/D = 1.5. 

The occupation number of the (lower) j e s = 3/2 or- 
bitals as a function of on-site Coulomb interaction U 
is ploted in FigJS] for three typical SOC strength. For 
(/D = 0.1, to some extent, the occupation behavior is 
similar to ( = case, in which the occupation number 
is only slightly changed by the interaction. The situa- 
tion is quite different for Q/D = 0.5, where the occupa- 
tion of the jeff = 3/2 orbital increases with interaction 
at the beginning and decreases slightly after the tran- 
sition to the band insulator phase. The non-monotonic 
behavior here is mainly due to the competition between 
the repulsive interaction U and Hund's rule coupling J. 
The effect of U will always enhance the splitting of the 
local orbitals to reduce the repulsive interaction among 
these orbitals. While the Hund's rule coupling intents 
to distribute the electrons more evenly among different 
orbitals. For Q/D = 1.5 case, occupation number in the 
two subsets is fully polarized at U — and the effect of 
Hund's coupling term will reduce the occupation of the 
j e ff = 3/2 orbital monotonically. 

At last, the expectation value of the total orbital angu- 
lar momentum (£ 2 ), spin angular momentum (S 2 ) and 
total angular momentum as a function of Coulomb 
interaction U are plotted in FigJTl where Q/D is fixed 
to 0.70. In the non-interacting case, all the three ex- 
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pectation values can be calculated exactly and they will 
approach the atomic limit with the increment of inter- 
action U and J. In the atomic limit the SOC strength 
is much weaker than the Hund's coupling J, the ground 
state can be well described by the LS coupling scheme, 
where the four electrons will first form a state with total 
orbital angular momentum C = 1 and total spin momen- 
tum 5 = 1, and then form a spin-orbital singlet state with 
total angular momentum J = 0. From Fig|71 we can find 
that the system approaches the spin-orbital singlet quite 
rapidly after the transition to the band insulator phase. 
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metho d 28 ' 29 . In this section, we compare the results ob- 
tained by RIGA and HFA. As shown in FigUl the effec- 
tive SOC obtained by HFA increases quite rapidly with 
the interaction U and J. While the results obtained 
by RIGA show very different behavior. For weak SOC 
strength, i.e. C,/D — 0.1, the effective SOC obtained 
by RIGA increases first then decrease. This interesting 
non-monotonic behavior reflects the competition between 
the repulsive interaction U , which intends to increase the 
occupation difference for j c g = 1/2 and j c g = 3/2 or- 
bitals, and the Hund's rule coupling J , which intents to 
decrease the occupation difference. While for relatively 
strong SOC strength, the effective SOC increases with 
interaction U (and J) monotonically all the way to the 
phase boundary indicating the repulsive interaction U 
plays a dominate role here. But compared to HFA, the 
enhancement of effective SOC induced by the interaction 
is much weaker even for the latter case. This is mainly 
due to the reduction of the high energy local configura- 
tions in the Gutzwiller variational wave function com- 
pared to the Hatree Fock wave function, which greatly 
reduces the interaction energy and its derivative to the 
orbital occupation. 



IV. CONCLUDING REMARKS 



FIG. 8. (Color online) Evolution of effective SOC strength 
with increasing Coulomb U(J/U = 0.25) for selected SOC 
(C/D — 0.1,0.5), A comparison of results derived by RIGA 
and HFA are presented. 



B. Effective spin-orbit coupling 

In the multi-orbital system, the interaction effects will 
mainly cause two consequences for the metallic phases: 
(1) It will introduce renormalization factor for the energy 
bands; (2) It will modify the local energy level for each 
orbital which splits the bands. For the present model, 
the second effect will modify the effective SOC, which 
is another very important problem for the spin orbital 
coupled correlation system. Within the Gutzwiller vari- 
ational scheme used in the present paper, the effective 
SOC can be defined as: 

l dE mt (Sn°) l dE soc {6n°) 
^ cff " 2 d5n° 2 dSnO ' [ZV 

where Ei nt and E soc are the ground state expectation 
values of interaction and SOC terms in the Hamilto- 
nian respectively. Note the second term is different from 
the bare SOC Co unless n a is a good quantum num- 
ber. If the interaction energy is treated by Hartree Fock 
mean field approximation (HFA), the above equation 
gives Ceff = -dEg((Sn°)/(2d6n°) + Co, which will al- 
ways greatly enhance the spin-orbital splitting with the 
increasing U as found by some works based on LDA+U 



The Mott MIT in three-band Hubbard model with full 
Hund's rule coupling and SOC is studied in detail using 
RIGA and DMFT+CTQMC methods. First, we propose 
the phase diagram with the strength of electron-electron 
interaction and SOC. Three different phases have been 
found in the U — £ plane, which are metal, band insula- 
tor and Mott insulator phases. For 0.00 < (/D < 0.24, 
increasing Coulomb interaction will induce a MIT tran- 
sition from metal to Mott insulator. For 0.24 < Q/D < 
1.33, effect of U will cause two successive transitions, first 
from metal to band insulator, then to Mott insulator. For 
£/D > 1.33, a transition from band insulator to Mott in- 
sulator is observed. From the phase diagram, we find that 
the critical interaction strength U c is strongly reduced by 
the presence of SOC, which leads to the conclusion that 
the SOC will greatly enhance the strong correlation ef- 
fects in these systems. Secondly, we have studied the ef- 
fect of electron-electron interaction on the effective SOC. 
Our conclusion is that the enhancement of effective SOC 
found in HFA is strongly suppressed once we go beyond 
the mean field approximation and include the fluctuation 
effects by RIGA or DMFT methods. 
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